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Description 

BACKGROUND OF THE INVENTION 

1. Field of the Invention 

The present invention relates to a system for multi- 
plexing and transmitting a digital audio signal and a dig- 
ital video signalrand more" particularly to a signal'multi- 
plexing apparatus for multiplexing a digital audio signal 
and a digital video signal, and a signal separating appa- 
ratus for separating the digital audio signal and the dig- 
ital video signal from the transmitted multiplexed signal. 

2. Description of the Prior Art 

Recently, as the method for transmitting digital vid- 
eo signals in a broadcasting station, the serial transmis- 
sion system of transmitting digital data in a serial form 
has come to be used progressively. This transmission 
system is standardized as SMPTE (Society of Motion 
Picture and Television Engineers) 259M Standard. In 
this standard, in the synchronizing signal portion of the 
digital video signal, other signal than the video signal 
can be multiplexed and transmitted, and as an example 
thereof, the digital audio signal is multiplexed. 

In such transmission apparatus, an audio signal en- 
tered in one line of a video signal is multiplexed and 
transmitted in the horizontal synchronizing period of the 
next or subsequent video signal. A buffer RAM (random 
access memory) is required for time axis correction of 
the audio signal in each of the transmitter and receiver. 
Generally, no audio signal is multiplexed in the line for 
changing over the video signal or in the next line to pre- 
vent influences of the changeover on the audio signal. 
In particular, in the composite video signal, audio signal 
is not multiplexed in the line containing the equalizing 
pulse, and the audio signals to be transmitted in this pe- 
riod are multiplexed together in a vertical synchronizing 
period, so that a buffer RAM of a sufficiently large ca- 
pacity is required. 

A structural example of such buffer RAM is dis- 
closed in Japanese Laid-open Patent Application N° JP- 
A-04 313 979. In this known art, a memory of two ports 
is used for time axis correction of audio signal. The writ- 
ing address is compared with a value obtained by add- 
ing a specified value to the reading address, and the 
reading address is controlled so that the reading ad- 
dress added with the specified value may not overrun 
the writing address, 

In this method, it is guaranteed only that the writing 
address is ahead of the reading address by the specified 
value. The mean value of the differences between the 
writing address and reading address is guaranteed 
more than the specified value, but does not become just 
the specified value. Therefore, the delay of the audio 
signal with respect to the video signal is not constant, 
and it varies depending on the initial state of the trans- 



mitting apparatus or the line from which the input video 
signal begins to be inputted. Fluctuation of the delay 
time of the audio signal is disadvantageous when the 
timings of the video and audio signals are adjusted to 
5 be the same by delaying the video signal with respect 
to the audio signal before transmission or after trans- 
mission. 
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SUMMARY OF THE INVENTION 
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it is hence a primary object of the invention to 
present a video signal and audio signal multiplexing ap- 
paratus and separating apparatus capable of easily 
keeping the isochrony of a video signal and an audio 

is signal by setting constant the delay time of the audio 
signal with respect to the video signal. 

To achieve the above object, the invention provides 
a control of a buffer memory for time axis adjustment of 
an audio signal, in which the number of audio signal 

20 samples in the buffer memory is detected in every n 
fields (n being a positive integer) of a video signal, and 
a read address or a write address of the buffer memory 
is preset when the detected number of samples reaches 
a specified value, thereby keeping constant the number 

25 of audio signal samples in the buffer memory at the in- 
spection point occurring at intervals of n fields. 

Alternatively, the number of audio signal samples in 
the buffer memory is inspected in one field or more, a 
line having a maximum value or a minimum value of the 

30 detected number of samples is stored, and thereafter 
the number of audio signal samples in the buffer mem- 
ory in the line is similarly kept at a specified value, so 
that the capacity of the buffer memory may be utilized 
effectively. 

35 On the other hand, as a method of recovering the 
isochrony of the video signal and audio signal, a delay 
time of the audio signal with respect to the video signal 
in a predetermined line of the video signal is kept con- 
stant at the transmission side, and the video signal is 

^0 delayed at the reception side to recover the isochrony 
of the two signals on the basis of the delay time of the 
audio signal with respect to video signal in the same line. 

Particularly, in order to achieve the above objects, 
the present invention relates to a signal multiplexing ap- 

45 paratus for multiplexing a digital signal on a digital video 
signal, comprising : 



a buffer memory for temporarily storing an input dig- 
ital audio signal for time axis adjusting ; 
means for generating a multiplexing timing signal 
by detecting a sync signal period of an input digital 
video signal ; 

an audio signal formatter for packetting a digital au- 
dio signal outputted from the buffer memory into a 
packet in a format suited to multiplexing according 
to the multiplexing timing signal ; and 
a multiplexing circuit for multiplexing the packet on 
the input digital video signal according to the multi- 
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plexing timing signal to obtain a multiplexed digital 
video signal, 

which is characterized by further comprising : 

field timing generating means for generating a field 
timing signal which is a timing pulse occurring at a 
specific video line in every n fields of the video sig- 
nalrwhereTris~a p^ 

audio data quantity detecting means for detecting 
the number of audio data samples in the buffer 
memory in response to the field timing signal ; and 
address presetting means for presetting a read ad- 
dress or a write address of the buffer memory so as 
to keep constant the number of audio data samples 
in the buffer memory in every n fields when the de- 
tected number of audio data samples is out of a spe- 
cific range or different from a specified value, 
whereby a time delay of the multiplexed audio sig- 
nal with respect to the video signal is kept constant. 

The present invention also relates to a correspond- 
ing signal separating apparatus for separating a digital 
audio signal from an input multiplexed digital video sig- 
nal on which a digital audio signal is multiplexed. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a block diagram showing an embodiment 
of a signal multiplexing apparatus of the invention. 

Fig. 2 is a block diagram showing an embodiment 
of a signal separating apparatus of the invention. 

Fig. 3 is a block diagram showing an embodiment 
of application of the invention in both transmission and 
reception. 

Fig. 4 is a block diagram showing another embodi- 
ment of a signal separating apparatus of the invention. 

DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 

An embodiment of a signal multiplexing apparatus 
of the invention is shown in Fig. 1 . An input digital video 
signal AO is supplied into a field timing generating circuit 
1 , a multiplexing timing generating circuit 2, and a mul- 
tiplexing circuit 8. On the other hand, an input digital au- 
dio signal CO, which is generally serial, is converted into 
a parallel data EO in an audio input circuit 5 comprising 
a serial/ parallel converting circuit 5a and an audio clock 
reproducing circuit 5b, and is fed into a buffer RAM 6 
together with a write clock FO. The buffer RAM 6 com- 
prises a write address counter 6a, a read address coun- 
ter 6b, and a memory 6c having two ports for read and 
write. The write address counter is incremented in re- 
sponse to the write clock FO, and the read address coun- 
ter is incremented in response to a read clock LO. 

The multiplexing timing generating circuit 2 com- 
prises a video sync signal detecting circuit 2a, a hori- 



zontal period counter 2b, and a decoder 2c. The multi- 
plexing timing generating circuit 2 detects the synchro- 
nizing period of the video signal for multiplexing the au- 
dio signal, and generates timing signals NO, PO for mul- 
s tiplexing. By this timing signal NO, an audio signal data 
formatter 7 comprising a latch circuit 7a, a selector cir- 
cuit 7b, and a header generating circuit 7c issues the 
read clock LO to the buffer RAM 6 to read out an audio 
"sip^raata"M07a7Td'issues~the audio~signal"data~MO"by~ 
io converting it into a packet QO in a format to be multi- 
plexed to the video signal. This packet QO is supplied to 
the multiplexing circuit 8. The multiplexing circuit 8, 
which comprises a selector circuit 8a, changes over the 
digital video signal AO and the audio signal data packet 

15 QO in time division depending on the timing signal PO, 
and issues a multiplexed video signal RO. 

On the other hand, in the field timing generating cir- 
cuit 1 , which comprises a video sync signal detecting 
circuit 1 a, a horizontal period counter 1 b, a video line 

20 counter 1 c, a field period counter 1 d, and a decoder le, 
detects the field period from the video signal AO, and 
generates one pulse in every n fields (n being a positive 
integer) as a field timing signal DO. Herein, n denotes 
the number of fields in which the number of samples of 

25 audio signal in this period is always a positive integer. 
When the video signal is NTSC and the sampling fre- 
quency of the audio signal is 48 kHz, the number of au- 
dio signal samples in a five-frame period of the video 
signal is 8008 samples, so that n=10 (or n=5) may be 

30 selected. In a buffer RAM data quantity inspecting circuit 
3, at the timing of the frame timing signal DO, an address 
difference between a read address HO from the read 
address counter 6b and a write address GO from the 
write address counter 6a is determined in a subtractor 

35 3b, and is compared in a comparator 3a with a specified 
value BO set by a specified data quantity setting means 
9. When the address difference is different from the 
specified value BO, a preset pulse K0 is issued to the 
read address counter 6b. Accordingly, a read address 

40 preset value JO obtained by subtracting the specified 
value BO from the write address GO in a read address 
setting circuit 4 comprising a subtractor 4a is preset in 
the read address counter 6b. As a result, the effective 
audio signal data quantity in the buffer RAM becomes 

45 equal to a value corresponding to the specified value 
BO. As long as the audio signal is synchronized with the 
video signal, the audio signal data quantity in each of 
the subsequent inspection timings is kept constant. If a 
switching between video signal and audio signal should 

50 occur, presetting of the read address occurs at the in- 
spection timing right after the switching, so that the au- 
dio signal data quantity in the buffer RAM is also equal 
to a value corresponding to the specified value in the 
subsequent inspection timings. 

55 Incidentally, by setting the specified value BO from 
outside of the apparatus, it is possible to control the de- 
lay time of the audio signal with respect to the video sig- 
nal by making use of the buffer RAM 6. 



3 



5 



EP 0 598 295 B1 



Furthermore, by setting the inspection timing at the 
timing when the data quantity in the buffer RAM is ex- 
pected to be minimum, underflow of the buffer RAM 6 
can be prevented by setting the specified value BO 
specified from outside to be largerthan 0. Therefore, the 
delay time can be controlled while easily preventing un- 
derflow of the buffer RAM. 

In this embodiment, an example of generating the 
- field timing from video signaris^hWnTbut the field tim-~ 
ing may be generated from other signal accompanying 
the video signal, for example, the composite sync signal. 

Fig. 2 shows an embodiment of a signal separating 
apparatus of the invention. 

An audio-multiplexed digital video signal A1 is fed 
into an audio data separating circuit 102 and a field tim- 
ing generating circuit 1 01 . In the audio data separating 
circuit 102, from the information in a header part of a 
packet of audio data multiplexed on the video signal, a 
signal N1 indicating the audio data multiplexed period 
is generated, and an audio data is separated as a par- 
allel data M1 by an audio signal data deformatter 107 
comprising a multiplexer 107a and a latch circuit 107b. 
This parallel audio data M1 is fed into a buffer RAM 106 
together with a write clock L1 . The buffer RAM 1 06 com- 
prises a write address counter 106a, a read address 
counter 106b, and a memory 106c having two ports for 
read and write. The write address counter 106a is incre- 
mented in response to the write clock L1 , and the read 
address counter 106b is incremented in response to a 
read clock F1 generated by an audio clock generating 
circuit 110. In an audio output circuit 105, a parallel audio 
data E1 is read out from the buffer RAM 1 06 by the read 
clock F1, converted into a format of AES (Audio Engi- 
neering Society) or EBU (European Broadcasting Un- 
ion), etc., and issued as a serial digital audio signal C1. 

On the other hand, in the field timing generating cir- 
cuit 101, the line, field, frame, etc. of the video signal 
are detected from the sync signal in the video signal, 
and one pulse is issued as a field timing signal D1, for 
example, in every audio frame period.that is, in every 
video field period in which the number of audio samples 
may be a positive integer. In a buffer RAM data quantity 
inspecting circuit 103, an address difference H1-G1 be- 
tween a read address H1 from the read address counter 
106b and a write address G1 from the write address 
counter 106a is calculated in a subtracter 103b, and is 
compared in a comparator 103a with a specified value 
B1 determined by a specified data quantity setting 
means 109. When the address difference H1-G1 at the 
timing of the field timing signal D1 is different from the 
specified value B1, a preset pulse K1 is issued to the 
read address counter 1 06b. Accordingly, a read address 
preset value J1 obtained by subtracting the specified 
value B1 from the write address G1 calculated in a read 
address setting circuit 104 is preset in the read address 
counter 1 06b. As a result, the effective audio signal data 
quantity in the buffer RAM 106 is equal to a specified 
data quantity corresponding to the specified value. As 
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far as the audio signal is synchronized with the video 
signal, the audio signal data quantity is kept constant in 
the subsequent inspection timings. If a switching be- 
tween video signal and audio signal occurs, presetting 
occurs to the read address at the inspection timing right 
after the switching, so that the audio signal data quantity 
in the buffer RAM is kept equal to the specified data 
quantity in the subsequent inspection timings. 

~Ah^m&a3iment~6f alrarisTrlissioiTapparatus" a^ 
ing the invention in both transmission and reception side 
is shown in Fig. 3. At the transmission side, a video sig- 
nal a passes through a video delay circuit 331 having a 
specific delay time, and enters a video-audio multiplex- 
ing circuit 332. On the other hand, an audio signal b 
passes through an audio delay circuit 333 capable of 
varying its delay time, and enters the video-audio mul- 
tiplexing circuit 332 to be multiplexed on the video sig- 
nal. A video line position data c for defining a delay time 
is fed into the video-audio multiplexing circuit 332. A 
specified delay time d is fed into the audio delay circuit 
333 and video-audio multiplexing circuit 332. In the vid- 
eo-audio multiplexing circuit 332, for example, accord- 
ing to the method described with reference to Fig. 1 , that 
is, by the method of keeping constant the audio data 
quantity in the buffer RAM in a video line specified by 
the video line position data c, while keeping the audio 
delay time in this line at a specific value, an audio signal 
b' is multiplexed on a video signal a'. In the audio delay 
circuit 333, the audio delay time is varied so that the 
delay time of the audio signal with respect to the video 
signal in the video line defined by the video line position 
data c of the transmission data g after multiplexing may 
be the specified delay time d. That is, the delay time of 
the audio delay circuit 332 is set so that the sum of the 
delay time by the video delay circuit 331 and the spec- 
ified delay time d may be equal to the sum of the delay 
time by the audio delay circuit 332 and the delay time in 
the specific line by the video-audio multiplexing circuit. 
A delayed data formatter 334 converts the video line po- 
sition data c and specified delay time d into such a for- 
mat as to be multiplexed on the video signal, and the 
delayed data f is multiplexed on the video signal e by 
the delayed data multiplexing circuit 335 to be the trans- 
mission data g. 

At the reception side, the transmission data g is fed 
into a video-audio separating circuit 336 to be separated 
into a video signal h and an audio signal i. The video 
signal h is issued as a video signal h' after being delayed 
for a specific time in a video delay circuit 338 having a 
specific delay time. From the transmission data g, more- 
over, a video line position data c' and a specified delay 
time d' are separated in a delayed data separating circuit 
337. The video line position data c* enters the video-au- 
dio separating circuit 336, and the audio delay time with 
respect to the video signal at a line indicated by the video 
line position data c' is kept constant by the method ex- 
plained with reference to Fig. 2. The specified delay time 
d* is fed into an audio delay circuit 339 capable of varying 
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its delay time, and the delay time is set on the basis of 
this specified delay time d' so as to recover the isochro- 
ny of the video signal h* and the audio signal i\ That is, 
the delay time of the audio delay circuit 339 is set so 
that the sum of the specified delay time d\ the delay time 
in the video line specified by the video line position data 
c' in the video-audio separating circuit 336, and the de- 
lay time in the audio delay circuit 339 may be equal to 
"the delaytimeln the^ide^delaycircTJir338". 

In this constitution, the isochrony of the video signal 
h' and audio signal i' can be securely recovered regard- 
less of the manner of multiplexing the audio signal at the 
transmission side. 

In the foregoing description, means for delaying the 
video signal is provided in each of the transmission side 
and reception side, but the delay of the video signal may 
be provided on either side only, or if the video signal is 
delayed from the audio signal in the case of, for exam- 
ple, prior reading of audio signal, the delay means may 
not be necessarily required. Incidentally, the audio delay 
circuit 332 may not be required, or a fixed-delay circuit 
may be usable. In this case, the specified delay time d 
may be varied accordingly. 

The constitutions of the video-audio multiplexing 
circuit and video-audio separating circuit are described 
with reference to Fig. 1 and Fig. 2, but it is not limitative 
as far as the delay time in a specific line is constant. 
Furthermore, if the delay time in specific line is not con- 
stant, as far as the delay time in the specific line, that is, 
the audio data quantity in the buffer RAM, can be de- 
tected, the invention can be realized by varying the de- 
lay time of the audio delay circuit 339 by the detected 
delay time, that is, by setting the delay time of the audio 
delay circuit so that the delay by the delay time detected 
by the audio-video separating circuit, the transmitted 
specified delay time and the delay time of the audio de- 
lay circuit may be equal to the delay time of the video 
delay circuit. 

Furthermore, by preliminarily specifying the specific 
video line position and the specified delay time at the 
transmission side and reception side, transmission of 
the video line position data c and the specified delay 
time d is not necessary, nor is necessary to vary the de- 
lay time of the audio delay circuit. 

Fig. 4 shows another embodiment of a signal sep- 
arating apparatus of the invention. An audio-multiplexed 
digital video signal A2 is fed into an audio data separat- 
ing circuit 202 comprising a pattern matching header de- 
tecting circuit 202a, a counter 202b, and a decoder 
202c, and a field timing generating circuit 201 compris- 
ing a sync signal detecting circuit 201 a, a horizontal pe- 
riod counter 201b, a video line counter 201c, and a field 
period counter 201 d. In the audio data separating circuit 
202, a signal N2 showing the period in which the audio 
data is multiplexed is generated from the information in 
a header part of a packet of audio data multiplexed on 
the video signal, and the audio data is separated as a 
parallel data M2 by an audio signal data deformatter 207 



comprising a multiplexer 207a and a latch circuit 207b. 
The parallel audio data M2 is fed into a buffer RAM 206 
together with a write clock L2. The buffer RAM 206 com- 
prises a write address counter 206a, a read address 
5 counter 206b, and a memory 206c having two ports for 
read and write. The write address counter 206a is count- 
ed up in response to the write clock L2, and the read 
address counter 206b is counted up in response to a 
read~cloclTF2 ^'enerat eel in~an audio clock generating 
w circuit 21 6. An audio output circuit 205 reads out a par- 
allel audio data E2 from the buffer RAM 206 by the read 
clock F2, converts the audio data E2 into a standard for- 
mat of AES (Audio Engineering Society) or EBU (Euro- 
pean Broadcasting Union), and issues a serial digital au- 
*5 dio signal C2. 

On the other hand, in the field timing generating cir- 
cuit 201, the line, field, frame, and others of the video 
signal are detected from the sync signal in the video sig- 
nal, and time position information such as line, field and 
frame of the video signal is detected and issued, in a 
subtractor 203, an address difference T2 = H2-G2 of a 
read address H2 from the read address counter 206b 
and a write address G2 from the write address counter 
206a is calculated. 

Initially, it is supposed that an inspection mode sig- 
nal W2 from an inspection mode determining circuit 21 4 
comprising a field timer 214a and a mode latch 214b 
indicates a minimum value detection mode. In this 
mode, a minimum value detecting circuit 21 0 always de- 
tects a minimum value of the address difference T2. 
Every time the minimum value is updated, a time posi- 
tion hold signal U2 is issued to a minimum value timing 
hold circuit 209, and at this timing the time position of 
line, field, frame and others is held. In this mode, buffer 
RAM address collision, that is, whether the address dif- 
ference T2 may be 0 or not, is detected by an address 
collision detecting circuit 211, and an address collision 
detection signal X2 is issued. A selector 215 selects the 
address collision detection signal X2 as a read address 
preset signal K2, and the read address setting circuit 
204 issues a value right after the write address G2 as a 
preset data J2. Therefore, when detecting the address 
collision, the read address H2 is the value right after the 
write address G2. Accordingly, the minimum value de- 
tected by the minimum value detecting circuit 21 0 is up- 
dated to a proper value. 

When absence of address collision over a specified 
period such as the audio frame period is detected by the 
field timer 214a, the mode latch 214b changes the in- 
spection mode signal W2 to a stationary mode. In this 
mode, the fluctuation of the audio data quantity in the 
buffer RAM has been settled by the minimum value de- 
tection mode within the range of the buffer RAM capacity 
(that is, address collision does not occur), and the time 
position of the line, field, frame and others of the video 
signal in which the data quantity becomes the minimum 
value has been held in the minimum value timing hold 
circuit 209. Coincidence of a minimum value time posi- 
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tion Z2 and present time position information S2 is de- 
tected by the minimum value timing detecting circuit 
213, and a time position coincidence signal V2 is issued 
to the inspection mode determining circuit 214. The in- 
spection mode determining circuit 21 4 issues only a first 
time position coincidence signal V2 after setting in the 
stationary mode to the selector 215 as V2\ In the sta- 
tionary mode, the selector 215 issues this time position 
-coincidence-signal V2' as a preset pulse~K2-of the read 
address counter 206b. The read address setting circuit 
204 subtracts a specified value B2 from the write ad- 
dress G2, and issues a read address preset value J2. 
This read address preset value J2 is preset in the read 
address counter 206b. As a result, the effective audio 
signal data quantity in the buffer RAM 206 becomes 
equal to a specified data quantity corresponding to the 
specified value B2. Thereafter, in a buffer RAM data 
quantity inspecting circuit 21 2, at every timing of the time 
position coincidence signal V2, it is judged if the address 
difference T2 is matched with the specified value B2 
from the specified data quantity setting means 209. As 
far as the audio signal is synchronized with the video 
signal, the audio signal data quantity in each of the sub- 
sequent time position coincidence timings is equal to the 
specified data quantity. If not coinciding, it is judged that 
a switching between the video signal and audio signal 
has took place, and a mismatching signal 1 2 is issued. 
If the mismatching signal 12 is issued, the inspection 
mode determining circuit 214 sets the inspection mode 
signal W2 in the minimum value detection mode again, 
and the minimum value is initially set in the minimum 
value detecting circuit 210, so that the same algorithm 
is repeated. 

Accordingly, the operating point of the buffer RAM 
can be specified by the minimum value, and the capacity 
of the buffer RAM can be effectively utilized, so that the 
isochrony of picture and sound is recovered in a buffer 
RAM of small capacity. 

In the embodiment, only the minimum value of the 
data quantity in the buffer RAM was determined, but it 
is also possible to control the buffer RAM by determining 
a maximum value of the data quantity, or both the max- 
imum value and minimum value. 
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memory into a packet in a format suited to mul- 
tiplexing according to the multiplexing timing 
signal ; and 

a multiplexing circuit (8) for multiplexing the 
packet on the input digital video signal accord- 
ing to the multiplexing timing signal to obtain a 
multiplexed digital video signal, 

"characterized bv~f uTtheT corrTpfisihaT 

field timing generating means ( 1 ) for generating 
a field timing signal which is a timing pulse oc- 
curring at a specific video line in every n fields 
of the video signal, where n is a positive 
integer ; 

audio data quantity detecting means (3) for de- 
tecting the number of audio data samples in the 
buffer memory in response to said field timing 
signal ; and 

address presetting means (4) for presetting a 
read address or a write address of the buffer 
memory so as to keep constant the number of 
audio data samples in the buffer memory in 
every n fields when the detected number of au- 
dio data samples is out of a specific range or 
different from a specified value, whereby the 
time delay of the multiplexed audio signal with 
respect to the video signal is kept constant. 

A signal multiplexing apparatus according to claim 
1, further comprising means (9) for varying the 
specified value so as to vary the delay time of the 
multiplexed audio signal with respect to the video 
signal. 

A signal multiplexing apparatus according to claim 
1 , wherein the field timing generating means (1 ) in- 
cludes means (1c,1d) for detecting the specific vid- 
eo line of the video signal, and generates the field 
timing signal at the specific video line in every n 
fields of the video signal, thereby keeping constant 
the delay time of the multiplexed audio signal with 
respect to the video signal at the specific video line. 



Claims 

1. A signal multiplexing apparatus for multiplexing a 
digital audio signal on a digital video signal, 
comprising : 

a buffer memory (6) for temporarily storing an 
input digital audio signal for time axis adjusting ; 
means (2) for generating a multiplexing timing 
signal by detecting a sync signal period of an 
input digital video signal ; 
an audio signal formatter (7) for packetting a 
digital audio signal outputted from the buffer 



45 4. a signal multiplexing apparatus according to claim 

3, further comprising a delay circuit (331 ,333) for 
delaying at least one of the input digital video signal 
and the input digital audio signal, a delay time of the 
delay circuit being set so as to keep constant the 
delay time of the multiplexed audio signal with re- 
spect to the video signal at the specific video line. 

5. A signal multiplexing apparatus according to claim 

4, wherein the delay time of the multiplexed audio 
signal with respect to the video signal at the specific 
video line is 0. 

6. A signal multiplexing apparatus according to claim 
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4, further comprising means (335) for multiplexing 
on the video signal a data showing at least one of 
the specific video line and the delay time of the mul- 
tiplexed audio signal with respect to the video signal 
at the specific video line. s 
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video line of the video signal, and generates the 
field timing signal at the specific video line in every 
n fields of the video signal, thereby keeping con- 
stant the delay time of the output audio signal with 
respect to the video signal at the specific video line. 



7. A signal separating apparatus for separating a dig- 
ital audio signal from an input multiplexed digital vid- 

~ ^b^igna!~on~ which" a~digital alidio" signal is" multi : 
plexed, comprising : io 

means (102 ; 202) for generating a separation 
timing signal showing a multiplexed position of 
the digital audio signal from the input multi- 
plexed digital video signal ; is 
means (107 ; 207) for separating the digital au- 
dio signal from the input multiplexed digital vid- 
eo signal according to the separation timing 
signal ; 

a buffer memory (1 06; 206) for temporarily stor- 20 
ing the separated digital audio signal for time 
axis adjusting ; 

an audio clock generating circuit (1 1 0 ; 21 0) for 
generating an audio clock ; and 
memory control means (1 05 ; 205) for reading 25 
the audio data from the buffer memory by the 
audio clock to obtain an output audio signal, 

characterized by further comprising : 

30 

field timing generating means (101; 210,230) 
for generating a field timing signal which is a 
timing pulse occurring at a specific video line in 
every n fields of the video signal, where n is a 
positive integer ; ( 35 

audio data quantity detecting means (103; 
203) for detecting the number of audio data 
samples in the buffer memory in response to 
the field timing signal ; and 

address presetting means (104 ; 204) for pre- 40 
setting a read address or a write address of the 
buffer memory so as to keep constant the 
number of audio data samples in the buffer 
memory in every n fields when the detected 
number of audio data samples is out of a spec- 45 
ified range or different from a specified value, 
whereby the time delay of the output audio sig- 
nal with respect to the video signal is kept con- 
stant. 



8. A signal separating apparatus according to claim 7, 
further comprising means (109) for varying the 
specified value so as to vary the delay time of the 
output audio signal with respect to the video signal. 

9. A signal separating apparatus according to claim 7, 
wherein the field timing generating means (101) in- 
cludes means (101c,1 01d) for detecting the specific 



1 0. A signal separating apparatus according to claim 9, 
further comprising a separating circuit (337) for sep- 
arating a datashowihglhe specific~vicieo line mul : ' 
tiplexed on the input multiplexed digital video signal, 
wherein the field timing generating means (101) 
generates the field timing signal at the video line co- 
inciding with the specific video line indicated by the 
detected data. 

11. A signal separating apparatus according to claim 9, 
further comprising a delay circuit (338,339) for de- 
laying at least one of the digital video signal and the 
output digital audio signal, a delay time of the delay 
circuit being set so as to compensate for a delay 
time caused due to multiplexing and separation of 
the output audio signal with respect to the video sig- 
nal at the specific video line to thereby recover iso- 
chrony of the output video signal and the output au- 
dio signal. 

12. A signal separating apparatus according to claim 
11 , further comprising a separating circuit (337) for 
separating a data showing a delay time of the mul- 
tiplexed digital audio signal with respect to the dig- 
ital video signal in the specific video line multiplexed 
on the input multiplexed digital video signal, where- 
in the delay time of the delay circuit is set according 
to the delay time indicated by the data. 

1 3. A signal separating apparatus according to claim 7, 
wherein the field timing generating means 
(21 0,21 3) includes minimum value/maximum value 
detecting means (21 0) for detecting at least one of 
a minimum value and a maximum value of the de- 
tected number of audio data samples in a specific 
period and detecting a video line at which the min- 
imum value or the maximum value is detected, and 
determines as the specific video line the video line 
at which the minimum value or the maximum value 
has been detected. 

14. A signal separating apparatus according to claim 

13, further comprising a synchronous error detect- 
50 ing circuit (211) for detecting a synchronous error 

when the detected number of audio data samples 
is out of the specified range or different from the 
specified value. 

55 15. A signal separating apparatus according to claim 

14, further comprising means (214) for controlling 
said apparatus so as to start again from the detec- 
tion of the minimum value or maximum value by the 
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minimum value/maximum value detecting means 
(210) for the specific period when the synchronous 
error is detected by the synchronous error detecting 
circuit (211). 



Patentanspruche 

- 1. Signalmultiplexvorrichtung zum Multiplexen eines 
digital Audiosignals auf ein digitales Videosignal, 
mit : 



10 



einem Pufferspeicher (6) zum temporaren 
Speichern eines digitalen Eingangsaudiosi- 
gnals zum Adjustieren der Zeitachse; is 
Mitteln (2) zum Erzeugen eines Multiplexzeitsi- 
gnals zur Erkennung einer Periode des Sync- 
Signals eines digitalen Videoeingangssignals; 
eine Formatierungseinrichtung (7) des Audio- 
signals zum Paketieren eines digitalen Audio- 20 
signals, welches vom Pufferspeicher ausgege- 5. 
ben wird, in ein Paket, in einem Format welches 
zum Multiplexen entsprechend des Multiplex- 
zeitsignals geeignet ist; und 

einem Multiplexschaltkreis (8) zum Multiplexen 25 
des Pakets auf das digitals Videoeingangssi- 6. 
gnal entsprechend dem Multiplexzeitsignal um 
ein digitales Multiplexvideosignal zu erhalten, 



gekennzeichnet durch : 



30 ■ 



Feldzeiterzeugungsmittel (1).zum Erzeugen ei- 
nes Feldzeitsignals, dargestellt durch einen 
Zeitimpuls welcher alle n Felder des Videosi- 7. 
gnals in einer spezifischen Videolinie auftritt, 3S 
wobei n eine positive ganze Zahl ist; 
Audiodatenquantitatserkennungsmittel (3) zum 
Erkennen der Anzahl von Audiodatenmustern 
im Pufferspeicher, als Folge des Feldzeitsi- 
gnals; und 40 
Adressenvoreinsteliungsmittel (4) zum Vorein- 
stellen einer Leseadresse oder eine Schreib- 
adresse des Pufferspeichers um die Anzahl 
von Audiodatenmustern im Pufferspeicher in 
alien n Feldern konstant zu halten wenn die er- 45 
kannte Anzahl der Audiodatenmuster ausser- 
halb eines spezifischen Bereichs oder ver- 
schieden von einem spezifischen Wert ist, wo- 
bei die Zeitverschiebung des gemultiplexten 
Audiosignals im Vergleich zum Videosignal so 
konstant gehalten wird. 

Signalmultiplexvorrichtung nach Anspruch 1 , wel- 
che ferner Mittel (9) aufweist zum Varieren des spe- 
zifischen Wertes um die Zeitverschiebung des ge- ss 
multiplexten Audiosignals im Vergleich zum Video- 
signal zu verandern. 



Signalmultiplexvorrichtung nach Anspruch 1, in der 
die Feldzeiterzeugungsmittel (1) Mittel (1c, 1d) zum 
Erkennen der spezifischen Videolinie des Videos i- 
gnals aufweisen, und in der spezifischen Videolinie 
in alien n Feldern des Videosignals das Feldzeitsi- 
gnal erzeugen, wobei die Zeitverschiebung des ge- 
multiplexten Audiosignals im Vergleich zum Video- 
signal an der spezifischen Videolinie konstant ge- 
" Halten" wirci: " 

Signalmultiplexvorrichtung nach Anspruch 3, wel- 
che ferner einen Verzogerungschaltkreis (331 ,333) 
zum Verzogern von mindestens einem des digitalen 
Videoeingangssignals und des digitalen Audioein- 
gangssignals aufweisen, wobei die Zeitverzoge- 
rung des Verzogerungsschaltkreises so eingestellt 
ist, dass die Zeitverschiebung des gemultiplexten 
Audiosignals im Vergleich zum Videosignal an der 
spezifischen Videolinie konstant gehalten wird. 

Signalmultiplexvorrichtung nach Anspruch 4, in der 
die Zeitverschiebung des gemultiplexten Audiosi- 
gnals im Vergleich zum Videosignal an der spezifi- 
schen Videolinie 0 ist. 

Signalmultiplexvorrichtung nach Anspruch 4, wel- 
che ferner Mittel (335) aufweist zum Multiplexen 
von Daten auf das Videosignal, welche mindestens 
eine von den spezifischen Videolinien und der Zeit- 
verschiebung des gemultiplexten Audiosignal im 
Vergleich zum Videosignal an der spezifischen Vi- 
deolinie zeigt. 

Signaftrennvorrichtung zum Trennen eines digita- 
len Audiosignals von einem gemultiplexten digita- 
len Videoeingangssignal auf dem ein digitales Au- 
diosignal in gemultiplexter Weise aufgelagert ist, 
mit : 

Mitteln (102; 202) zum Erzeugen eines Trenn- 
zeitsignals welches eine gemultiplexte Position 
des digitalen Audiosignals vom digitalen ge- 
multiplexten Videoeingangssignal zeigt; 
Mitteln (107; 207) zum Trennen des digitalen 
Audiosignals vom gemultiplexten digitalen Vi- 
deoeingangssignal entsprechend des Trenn- 
zeitsignals; 

einem Pufferspeicher (106; 206) zum tempora- 
ren Speichern des getrennten digital Audiosi- 
gnals zur Zeitachsenadjustierung; 
einem Audiozeitbasisverzogungsschaltkreis 
(110; 210) zum Erzeugen einer Audiozeitbasis; 
und 

Speicherkontrolleinrichtungen (105; 205) zum 
Lesen der Audiodaten aus dem Pufferspeicher 
mittels der Audiozeitbasis um ein Audioaus- 
gangssignal zu erhalten, 
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ferner gekennzeichnet durch : 

Feldzeiterzeugungsmittel (101; 210, 230) zum 
Erzeugen eines Feldzeitsignals, dargestellt 
durch einen Zeitimpuls welcher in alien n Fel- 
dern des Videosignals an einer spezifischen Vi- 
deolinie auftritt, wobei n eine positive ganze 
Zahl ist; 

- - * Audiodatenquantitatserkennungsmittel (103;' 
203) zum Erkennen der Anzahl von Audioda- 
tenmustern im Pufferspeicher als Folge des 
Feldzeitsignals; und 

Adressenvoreinstellungsmittel (104; 204) zum 
Voreinstellen einer Leseadresse Oder einer 
Schreibadresse des Pufferspeichers um die 
Anzahl der Audiodatenmuster im Pufferspei- 
cher in alien n Feldem konstant zu halten wenn 
die erkannte Anzahl von Audiodatenmustern 
ausserhalb eines spezifischen Bereichs oder 
unterschiedlich von einem spezifischen Wert 
ist wobei die Zeitverzogerung des Audioaus- 
gangssignales im Vergleich zum Videosignal 
konstant gehalten wird. 

8. Signaltrennvorrichtung nach Anspruch 7, welche 
ferner Mittel (109) aufweist zum Varieren des spe- 
zifischen Wertes um die Zeitverschiebung des Au- 
dioausgangssignals im Vergleich zum Videosignal 
zu varieren. 

9. Signaltrennvorrichtung nach Anspruch 7, in der die 
Feldzeiterzeugungsmittel (101) Mittel (101c, 101d) 
zum Erkennen der spezifischen Videolinie eines Vi- 
deosignal enthalten und welche das Feldzeitsignal 
an der spezifischen Videolinie in alien n Feidern des 
Videosignals erzeugt, wodurch die Zeitverzogerung 
des Audioausgangssignals im Vergleich zum Vi- 
deosignal an der spezifischen Videolinie konstant 
gehalten wird. 

10. Signaltrennvorrichtung nach Anspruch 9, welche 
ferner einen Trennschaltkreis (337) zum Trennen 
von Daten, welche die spezifische Videolinie zeigen 
die auf das digitale gemultiplexte Videoeingangssi- 
gnal aufgemuitiplext sind, aufweist, wobei die Feld- 
zeiterzeugungsmittel (101) ein Feldzeitsignal an 
der Videolinie erzeugen, welche mit der spezifi- 
schen Videolinie zusammenfallt, die durch die er- 
kannten Daten bezeichnet wird. 

11. Signaltrennvorrichtung nach Anspruch 9 welche 
ferner einen Verzogerungschaltkreis (338,339) auf- 
weist zum Verzogern von zumindest einem des di- 
gitalen Videosignals und des digitalen Audioaus- 
gangssignals, wobei die Verzogerungszeit des Ver- 
zogerungsschaltkreises so eingestellt ist dass die 
Zeitverzogerung welche durch das Multiplexen und 
die Trennung des Audioausgangssignals im Ver- 



gleich zum Videosignal an der spezifischen Video- 
linie verursacht wurde, kompensiert wird, um die 
Isochronie des Videoausgangssignals und des Au- 
dioausgangssignals wiederherzustellen. 

5 

12. Signaltrennvorrichtung nach Anspruch 11, welche 
ferner einen Trennschaltkreis (337) aufweist zum 
Trennen von Daten welche eine Verzogerungszeit 

~~ das^eWultiple^enriigitalerr Audiosignals"im~Vef- 
10 gleich zum Videosignal in der spezifischen Videoli- 
nie zeigen, und welche auf das gemultiplexte Video- 
eingangssignal aufgemuitiplext sind, wobei die 
Zeitverzogerung des Verzogerungsschalkreises 
entsprechend der durch die Daten eingegebenen 
is Zeitverzogerung eingestellt ist. 

13. Signaltrennvorrichtung nach Anspruch 7, in der die 
Feldzeitverzogungsmittel (210, 213) Minimalwert/ 
Maximalwert Erkennungsmittel (210) aufweisen, 

20 zur Erkennung von zumindest einem, des Minimal- 
werts und des Maximal we rts der Anzahl von Au- 
diodatenmustern in einer spezifischen Periode, und 
zum Erkennen einer Videolinie an der der Minimal- 
wert oder der Maximalwert erkannt wird, und wel- 

25 che als spezifische Videolinie diejenige Videolinie 
bestimmt, an der der Minimalwert oder der Maxi- 
malwert entdeckt wurde. 

14. Signaltrennvorrichtung nach Anspruch 13, welche 
30 ferner eine Synch ronfehlererkennungse in richtung 

(211) aufweist zum Erkennen eines Synchronfeh- 
lers wenn die Anzahl von Audiodatenmustern aus- 
serhalb eines spezifischen Bereichs oder unter- 
schiedlich von einem spezifischen Wert ist. 

35 

15. Signaltrennvorrichtung nach Anspruch 14, welche 
ferner Mittel (214) aufweist zum Kontrollieren der 
Vorrichtung in einer Weise dass sie neu gestartet 
wird durch die Erkennung eines Minimalwerts oder 

40 Maximalwerts durch die Minimal wert/Maximalwert 
Erkennungseinrichtung (210) fur die spezifische 
Periode wenn der Synchronfehler durch den Syn- 
ch ronf eh le re rken nun gkreis (211) erkannt wird. 

45 

Revendications 

1. Dispositif de multiplexage d'un signal, pour multi- 
plexer un signal audio numerique sur un signal vi- 
so deo numerique, comportant : 

une memoire tampon (6) pour stocker de facon 
temporaire un signal audio numenque d'entree 
pour I'ajustage de I'axe du temps; 
55 un moyen (2) pour creer un signal de tempori- 

sation de multiplexage par la detection d'une 
periode d'un signal de synchronisation d'un si- 
gnal numerique video d'entree; 
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un moyen de formatage du signal audio (7) 
pour la formation en paquet d'un signal nume- 
rique audio sorti de la memoire de temporisa- 
tion dans un format adapts au multiplexage se- 
lon le signal de temporisation de multiplexage; s 
et 

un circuit de multiplexage (8) pour multiplexer 
ie paquet sur le signal video numerique d'en- 

tree seion-le signal de temporisation de-multi- 

plexage afin d'obtenir un signal video num6ri- to 
que multiplexe, 

caracterise en ce qu'il comporte en outre : 

un moyen de creation de temporisation de is 
champs (1) pour generer un signal de tempori- 
sation de champs qui est une impulsion de tem- 
porisation et qui apparaTt a une ligne video spe- 
cifique dans tous les n champs du signal video, 
ou n signifie un chiffre entier positif; 20 
un moyen de defection de la quantite de don- 
nees audio (3) pour detecter le nombre 
d'echantilions de donnSes audio dans la me- 
moire tampon en reponse au dit signal de tem- 
porisation de champs; et 25 
un moyen de predisposition d'adresses (4) 
pour predisposer une adresse de lecture ou 
une adresse d'ecriture de la memoire tampon 
afin de maintenir constant le nombre d'echan- 
tilions de donnSes audio dans la memoire tarn- 30 
pon de tous les n champs lorsque le nombre 
detects des echantillons de donnees audio est 
en dehors d'une gamme specifiee ou est diffe- 
rent d'une valeur specifiee, alors que le d§ca- 
lage de temps du signal audio multiplexe par 35 
rapport au signal video est maintenu constant. 

Dispositif de multiplexage d'un signal selon la re- 
vendication 1, comportant en outre un moyen (9) 
pour faire varier la valeur specifique afin de fa ire va- 40 
rier le decalage de temps du signal audio multiplexe 
par rapport au signal video. 

Dispositif de multiplexage d'un signal selon la re- 
vendication 1 , dans lequel le moyen de creation de 45 
temporisation de champs (1) inclut un moyen (1c, 
1 d) pour detecter la ligne video specifique du signal 
video et qui genere le signal de temporisation de 
champs a la ligne video specifique dans tous les n 
champs du signal video, maintenant constant, de so 
cette fagon, le decalage du temps du signal audio 
multiplexe par rapport au signal video a la ligne vi- 
deo specifique. 

Dispositif de multiplexage d'un signal selon la re- ss 
vendication 3, comportant en outre un circuit de de- 
calage (331 , 333) pour faire decaler dans le temps 
au moins un parmi le signal video numerique d'en- 



tr6e et le signal audio numerique d'entrSe, un de- 
calage de temps du circuit de decalage etant choisi 
afin de maintenir constant le decalage de temps du 
signal audio multiplexe par rapport au signal video 
a la ligne video specifique. 

5. Dispositif de multiplexage d'un signal selon la re- 
vendication 4, dans lequel le dScalage de temps du 

- signahaudio multiplexe parrapport au signal video 
a la ligne video specifique est egal a 0. 

6. Disposition de multiplexage d'un signal selon la re- 
vendication 4 comportant en outre un moyen (335) 
pour multiplexer sur le signal video des donnSes re- 
presentant au moins un parmi la ligne video spSci- 
fique et le deiai de temps du signal audio multiplexe 
par rapport au signal video a la ligne video specifi- 
que. 

7. Dispositif de separation de signal pour separer un 
signal audio numerique d'un signal video numeri- 
que d'entree multiplexe sur lequel un signal audio 
numerique est multiplexe, comportant: 

un moyen (1 02; 202) pour genSrer un signal de 
temporisation de separation reprSsentant une 
position multiplexed du signal numerique audio 
par rapport au signal numerique video multi- 
plexe; 

un moyen (1 07; 207) pour separer le signal nu- 
merique audio du signal numerique video mul- 
tiplexe selon le signal de temporisation de se- 
paration; 

une memoire tampon (106, 206) pour stocker 
de fagon temporal re le signal numerique audio 
separe pour I'ajustage de I'axe du temps; 
un circuit de generation d'horloge audio (110; 
210) pour generer une horloge audio; et 
un moyen de controle de memoire (105; 205) 
pour lire les donn6es audio de la memoire tam- 
pon par I'horloge audio afin d'obtenir un signal 
audio une sortie, 

caracterisS en ce qu'il comporte en outre : 

un moyen de generation de temporisation de 
champs (101 ; 210; 230) pour generer un signal 
de temporisation de champs qui est une impul- 
sion de temporisation et qui apparaTt a une li- 
gne video specifique dans tous les n champs 
du signal video, ou n est un chiffre entier positif; 
un moyen de detection de la quantite de don- 
nees audio (103; 203) pour detecter le nombre 
d'echantillons de donnSes audio dans la me- 
moire tampon en fonction du signal de tempo- 
risation de champs; et 

un moyen de predisposition d'adresses (104; 
204) pour predisposer une adresse de lecture 
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8. 



ou une adresse d'6criture de la m6moire tam- 
pon afin de maintenir constant le nombre 
d'echantillons de donnees audio dans la me- 
moire tampon dans tous les n champs lorsque 
le nombre detecte d'echantillons de donnees s 13. 
audio est en dehors d'une gamme specifiee ou 
est different d'une valeur specifiee, alors que le 
decalage dans le temps du signal audio de sor- 

tie -parrapport-au-stgnal video est-maintenu 

constant. 10 

Dispositif de separation de signal selon la revendi- 
cation 7, comportant en outre un moyen (109) pour 
faire varier la valeur specifique afin de faire varier 
le decalage dans le temps du signal audio de sortie is 
par rapport au signal video. 



multiplexe d'entree, dans lequel le decalage de 
temps du circuit de decalage est dispose selon le 
decalage dans le temps identifie par les donnees. 

Dispositif de separation de signal selon la revendi- 
cation 7, dans lequel le moyen de generation de 
temporisation de champs (210, 213) comporte un 
moyen de detection de valeur minimum/vale ur 
maximurrv(21 0) pour detecter au moins un parmi la 
valeur minimum et la valeur maximum du nombre 
detects d'echantillons de donnees audio dans une 
p6riode specifique et pour detecter la ligne video a 
laquelle la valeur minimum ou la valeur maximum 
est d^tectee et qui determine la ligne video a laquel- 
le la valeur minimum ou la valeur maximum a 6t6 
dStectee en tant que ligne video specifique. 



9. Dispositif de separation de signal selon la revendi- 
cation 7, dans laquelle le moyen de generation de 
temporisation de champs (1 01 ) comporte un moyen 
(101c, 101d) pour detecter la ligne vid^o specifique 
du signal video et qui genere le signal de tempori- 
sation des champs a la ligne video specifique dans 
tous les n champs du signal video, de facon a main- 
tenir constant le decalage dans le temps du signal 
audio de sortie par rapport au signal video a la ligne 
video specifique. 

10. Dispositif de separation de signal selon la revendi- 
cation 9, comportant en outre un circuit de separa- 
tion (337) pour separer des donnees representant 
la ligne video specifique multiplexee sur le signal 
numerique video d'entree multiplexe, dispositif 
dans lequel le moyen de generation de temporisa- 
tion de champs (101) genere le signal de tempori- 
sation de champs a la ligne video specifique qui 
coincide avec la ligne video specifiee identifiee par 
les donnees detectees. 



14. Dispositif de separation de signal selon la revendi- 
cation 13, comportant en outre un circuit de detec- 
tion d'erreurs synchrones (211) pour detecter une 
erreur synch rone lorsque le nombre detecte 
d'echantillons de donnees audio est en dehors 
d'une gamme specifiee ou est different d'une valeur 
specifiee. 

15. Dispositif de separation de signal selon la revendi- 
cation 14, comportant en outre des moyens (214) 
pour controler ledit appareil afin de redemarrer 
apres la detection d'une valeur minimum ou d'une 
valeur maximum par le moyen de detection de va- 
leur minim um/valeur maximum (210) pour la perio- 
de specifiee lorsque I'erreur synchrone est detectee 
par le circuit de detection d'erreurs (211). 



25 
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11. Dispositif de separation de signal selon la revendi- 40 
cation 9, comportant en outre un circuit de decalage 
(338,339) pour decaler dans le temps au moins un 
parmi le signal video numerique et le signal audio 
numerique de sortie, un decalage dans le temps du 
circuit de decalage etant dispose de facon a com- 45 
penser pour le decalage dans le temps qui est cau- 
se par le multiplexage et la separation du signal 
audio de sortie et du signal video a la ligne video 
specifique afin de recuperer i'isochronie du signal 
vid6o de sortie et du signal audio de sortie. 50 



12. Dispositif de separation de signal selon la revendi- 
cation 11, comportant en outre un circuit de sepa- 
ration (337) pour s6parer des donnees represen- 
tant un decalage dans le temps du signal audio nu- 55 
merique multiplexe par rapport au signal video nu- 
merique dans la ligne video specifie, donnees qui 
sont multip!ex6es sur le signal vid6o numerique 
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